Tape drive library integrated memory deduplication

ABSTRACT

A method and system for improving tape drive memory storage is provided. The method includes receiving, by a storage tape drive hardware device, a data stream. Duplicate data chunks of the data stream are identified and deleted such that a group of data chunks remain in a non-volatile memory device (NVS 2 ) of the storage tape drive. The group of data chunks is written to a data storage tape cartridge. Pointers are generated and stored within the data storage tape cartridge. The pointers are associated with a location within an NVS 1  for storing de-duplication hashes identifying each data chunk of the group of data chunks stored within data storage tape cartridge. The de-duplication hashes are written by from the NVS 1  to a manager non-volatile memory device (MNVS) of a storage tape drive hardware library system. The MNVS is updated.

FIELD

The present invention relates generally to a method for efficientlyde-duplicating data stored on a tape drive and in particular to a methodand associated system for optimizing a de-duplication process within atape library.

BACKGROUND

Processes for implementing a data deduplication environment are wellknown. A typical data deduplication environment for random accessiblestorage systems such as disk drives and flash memory typically includesa data chunk database including information identifying data chunks andassociated metadata. A large number of solutions currently exist withrespect to de-duplicating data stored on disk drives and flash memory asthe aforementioned memory structures allow a process for de-duplicatingdata to be performed at any time as the data may be accessed without anydelay. In tape storage environments data is usually written once in asequential manner that includes a read delay due to a positioning of atape to with respect to a read/write head. A large number of solutionscurrently exist with respect to de-duplicating data in multiple storagemedia

However, the aforementioned solutions may be associated with tape drivestorage limitations and speed issues thereby limiting a performance ofde-duplication systems. Additionally, the aforementioned solutions maynot be enabled to allow for tape drive data compression without the useof a learning curve.

Accordingly, there exists a need in the art to provide a process forcompressing data via a de-duplication method executed within a tapedrive library.

SUMMARY

A first aspect of the invention provides a tape drive memory storageimprovement method comprising: receiving, by a processor of a storagetape drive hardware device of a storage tape drive hardware librarysystem comprising a plurality of storage tape drive hardware devices, adata stream for storage, wherein the storage tape drive hardware deviceinternally comprises a deduplication software engine, a non-volatilememory device (NVS1), a non-volatile memory device (NVS2), and a firstdata storage tape cartridge; identifying, by the processor within theNVS2, duplicate data chunks of a plurality of adjacent variable lengthdata chunks of the data stream, wherein the duplicate data chunkscomprise duplicated data with respect to a first group of data chunks ofthe plurality of adjacent variable length data chunks; deleting, by theprocessor from the NVS2, the duplicate data chunks such that the firstgroup of data chunks remain within the NVS2; writing, by the processorto a first data storage tape cartridge of the storage tape drivehardware device, the first group of data chunks; generating, by theprocessor, pointers associated with a location within the NVS1 storingde-duplication hashes identifying each data chunk of the first group ofdata chunks stored within first data storage tape cartridge; storing, bythe processor, the pointers within the first data storage tapecartridge; writing, by the processor from the first NVS1 to a managernon-volatile memory device (MNVS) of the storage tape drive hardwarelibrary system, the de-duplication hashes; and updating, by theprocessor, the MNVS by combining the de-duplication hashes with aplurality of additional de-duplication hashes identifying a plurality ofcommonly used de-duplicated data chunks stored within the plurality ofstorage tape drive hardware devices.

A second aspect of the invention provides a A computer program product,comprising a computer readable hardware storage device storing acomputer readable program code, the computer readable program codecomprising an algorithm that when executed by a processor of a storagetape drive hardware device implements a tape drive memory storageimprovement method, the method comprising: receiving, by the processor,a data stream for storage, wherein the storage tape drive hardwaredevice is comprised by a storage tape drive hardware library systemcomprising a plurality of storage tape drive hardware devices, andwherein the storage tape drive hardware device internally comprises adeduplication software engine, a non-volatile memory device (NVS1), anon-volatile memory device (NVS2), and a first data storage tapecartridge; identifying, by the processor within the NVS2, duplicate datachunks of a plurality of adjacent variable length data chunks of thedata stream, wherein the duplicate data chunks comprise duplicated datawith respect to a first group of data chunks of the plurality ofadjacent variable length data chunks; deleting, by the processor fromthe NVS2, the duplicate data chunks such that the first group of datachunks remain within the NVS2; writing, by the processor to a first datastorage tape cartridge of the storage tape drive hardware device, thefirst group of data chunks; generating, by the processor, pointersassociated with a location within the NVS1 storing de-duplication hashesidentifying each data chunk of the first group of data chunks storedwithin first data storage tape cartridge; storing, by the processor, thepointers within the first data storage tape cartridge; writing, by theprocessor from the first NVS1 to a manager non-volatile memory device(MNVS) of the storage tape drive hardware library system, thede-duplication hashes; and updating, by the processor, the MNVS bycombining the de-duplication hashes with a plurality of additionalde-duplication hashes identifying a plurality of commonly usedde-duplicated data chunks stored within the plurality of storage tapedrive hardware devices.

A third aspect of the invention provides a storage tape drive hardwaredevice comprising a processor coupled to a computer-readable memoryunit, the memory unit comprising instructions that when executed by theprocessor implements a tape drive memory storage improvement methodcomprising: receiving, by the processor, a data stream for storage,wherein the storage tape drive hardware device is comprised by a storagetape drive hardware library system comprising a plurality of storagetape drive hardware devices, and wherein the storage tape drive hardwaredevice internally comprises a deduplication software engine, anon-volatile memory device (NVS1), a non-volatile memory device (NVS2),and a first data storage tape cartridge; identifying, by the processorwithin the NVS2, duplicate data chunks of a plurality of adjacentvariable length data chunks of the data stream, wherein the duplicatedata chunks comprise duplicated data with respect to a first group ofdata chunks of the plurality of adjacent variable length data chunks;deleting, by the processor from the NVS2, the duplicate data chunks suchthat the first group of data chunks remain within the NVS2; writing, bythe processor to a first data storage tape cartridge of the storage tapedrive hardware device, the first group of data chunks; generating, bythe processor, pointers associated with a location within the NVS1storing de-duplication hashes identifying each data chunk of the firstgroup of data chunks stored within first data storage tape cartridge;storing, by the processor, the pointers within the first data storagetape cartridge; writing, by the processor from the first NVS1 to amanager non-volatile memory device (MNVS) of the storage tape drivehardware library system, the de-duplication hashes; and updating, by theprocessor, the MNVS by combining the de-duplication hashes with aplurality of additional de-duplication hashes identifying a plurality ofcommonly used de-duplicated data chunks stored within the plurality ofstorage tape drive hardware devices.

The present invention advantageously provides a simple method andassociated system capable of implementing a data deduplicationenvironment.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a storage tape drive hardware device for improving atape drive memory storage process, in accordance with embodiments of thepresent invention.

FIG. 2 illustrates a process for deduplicating and writing data viainternal non-volatile memory devices, in accordance with embodiments ofthe present invention.

FIG. 3 illustrates a further process with respect to the process of FIG.2, in accordance with embodiments of the present invention.

FIG. 4 illustrates a process for reading deduplicated data from a tapecartridge via internal non-volatile memory devices, in accordance withembodiments of the present invention.

FIG. 5 illustrates a further process with respect to the process of FIG.4, in accordance with embodiments of the present invention.

FIG. 6 illustrates a process executed within a storage tape drivehardware device, in accordance with embodiments of the presentinvention.

FIG. 7 illustrates a storage tape drive hardware library system forimproving a tape drive memory storage process, in accordance withembodiments of the present invention.

FIG. 8 illustrates a storage tape drive hardware library systemcomprising multiple storage tape drive hardware devices, in accordancewith embodiments of the present invention.

FIG. 9 illustrates a detailed view of a tape library manager, inaccordance with embodiments of the present invention.

FIG. 10 illustrates an operational algorithm detailing a process flowenabled by the system of FIG. 1 for executing a hash database enabledprocess, in accordance with embodiments of the present invention.

FIG. 11 illustrates a process for deduplicating and writing data via anNVS1 and an NVS2 1108, in accordance with embodiments of the presentinvention.

FIG. 12 illustrates a further process with respect to the process ofFIG. 11, in accordance with embodiments of the present invention.

FIG. 13 illustrates a process for reading deduplicated data from a tapecartridge via an NVS1 and an NVS2, in accordance with embodiments of thepresent invention.

FIG. 14 illustrates a further process with respect to the process ofFIG. 13, in accordance with embodiments of the present invention.

FIG. 15 illustrates a process identifying missing data chunks, inaccordance with embodiments of the present invention.

FIG. 16 illustrates a process identifying corrupt data chunks, inaccordance with embodiments of the present invention.

FIG. 17 illustrates an algorithm detailing a process flow enabled by thesystem of FIG. 1 for improving tape drive memory storage via executionof an internal data deduplication process, in accordance withembodiments of the present invention.

FIG. 18 illustrates a computer system used by or comprised by the systemof FIG. 1 for improving a tape drive memory storage process, inaccordance with embodiments of the present invention.

DETAILED DESCRIPTION

FIG. 1 illustrates a storage tape drive hardware device 100 forimproving a tape drive memory storage process, in accordance withembodiments of the present invention. Typical de-duplication processesare usually associated with random accessible storage systems such asdisk drives and flash memory devices. The de-duplication processes aretypically applied to the aforementioned memory storage systems due tothe ability of a de-duplication process to be performed at any time anddata is able to be accessed without any delay. Executing ade-duplication process with respect to data stored on a tape drivestorage device may result in tape drive storage limitations and speedissues. The aforementioned tape drive de-duplication process may causede-duplication system performance issues thereby causing storage delays.

Data deduplication is defined herein as a specialized data compressiontechnique for eliminating duplicate copies of repeating data portions(or chunks) from a data stream. A data de-duplication process is used toimprove (tape drive device) memory storage utilization. A de-duplicationprocess identifies and stores unique chunks of data or byte patternsduring an analysis process. During the analysis process, additional datachunks are compared to the stored data chunks and whenever a matchoccurs, a duplicate (redundant) data chunk is replaced with a pointer(reference) that points to a location for the stored data chunk.

Storage tape drive hardware device 100 enables a mechanism forcompressing data via a deduplication process executed directly withinstorage tape drive hardware device 100 without the need of a host ordata management system. Storage tape drive hardware device 100integrates a deduplication module internally comprising additionaldeduplication memory devices (i.e., non-volatile memory device 104 andnon-volatile memory device 108) to temporary store deduplicated datachunks linked to reference pointers. During each data write execution, adeduplication software engine removes deduplicated data chunks from adata stream and replaces them with a pointer to the deduplication memorydevices and when a data storage tape cartridge is full or is removedfrom storage tape drive hardware device 100, data content of thededuplication memory device is written to a reserved position of thedata storage tape cartridge. Therefore, the data storage tape cartridgecontains compressed data (i.e., data without the data chunks identifiedas duplicates) and all data from the deduplication memory device. When adata storage tape cartridge is mounted to storage tape drive hardwaredevice 100, all detected reserved portions (of the data storage tapecartridge) are read thereby filling the deduplication memory device.Therefore, a data read process may be performed by reading compresseddata and decoding the compressed data by replacing an associated pointerwith data from the deduplication memory device.

Storage tape drive hardware device 100 of FIG. 1 includes a non-volatilememory device (NVS1) 104, a non-volatile memory device (NVS2) 108, tapedrive motors 109a and 109b, and control circuitry 117 including adeduplication software engine for controlling all functionalityassociated with storage tape drive hardware device 100. NVS1 and NVS2may comprise any type of specialized memory devices including, interalfa, an integrated circuit based memory device, a removable flashmemory device, etc. Storage tape drive hardware device 100 may comprisean embedded computer or any type of specialized embedded hardwaredevice. An embedded computer is defined herein as a dedicated computercomprising a combination of computer hardware and software (fixed incapability or programmable) specifically designed for executing aspecialized function. Programmable embedded computers may comprisespecialized programming interfaces. Additionally, storage tape drivehardware device 100 may comprise a specialized hardware devicecomprising specialized (non-generic) hardware and circuitry (i.e.,specialized discrete non-generic analog, digital, and logic basedcircuitry) for executing a process described with respect to FIGS. 1-8.The specialized discrete non-generic analog, digital, and logic basedcircuitry may include proprietary specially designed components (e.g., aspecialized integrated circuit designed for only implementing anautomated process for improving tape drive memory storage process).Storage tape drive hardware device 100 of FIG. 1 includes specializedmemory devices NVS1 104 and NVS2 108. The specialized memory may includea single memory system. Alternatively, the specialized memory mayinclude a plurality of memory systems. Storage tape drive hardwaredevice 100 may include sensors, processors, and additional software andspecialized circuitry. Sensors may include, inter alfa, storage sensors,optical sensors, speed sensors, etc.

Storage tape drive hardware device 100 enables a process forstoring/buffering data sets within NVS2 108 prior to being written to adata storage tape cartridge such that during a data write process thestored/buffered data sets are analyzed by diving the datasets intolarger segments such that each data segment comprises a collection ofadjacent variable-length data chunks derived via execution of a chunkingalgorithm. The analyzed data segments are used to create a chunk-listfile and compute one or more similarity identifiers for storage withinan index. The chunk list file (i.e., a temporary repository) is storedwithin NVS1 104. During a process for directly streaming the contents ofNVS2 108 to a (physical) data storage tape cartridge, storage tape drivehardware device 100 executes a process for the building chunk list fileand initiates a counting process to determine matching data chunkslocated within a first few hundred mega bytes of data. The countingprocess is executed util a specified threshold is reached and allfurther identical data chunks are deleted from NVS2 108. Additionally,position pointers (i.e., pointing to a position within data storage tapecartridge) are written to NVS1 104. All data chinks deleted from NVS2108 are written to data storage tape cartridge thereby improving thememory via a space saving process.

FIG. 2 illustrates a process 200 for deduplicating and writing data viaNVS1 204 and NVS2 208, in accordance with embodiments of the presentinvention. Process 200 illustrates a data stream 205 received from adata host device. Data stream 205 is processed (within NVS2 208) by adeduplication software engine 210 (comprising software microcode)resulting in the deletion of data chunks “A” and “B” from NVS2 208.Additionally, a position pointer associated with the remaining datachunks 218 (being stored within tape cartridge 4711) is stored within achunk index database within NVS1 204. A subsequent analysis is performedto analyze the incoming data stream 224 until a specified number (i.e.,a threshold) of duplicate data chunks are identified. For example (withrespect to FIG. 2), data chunk “A” has been identified three times anddata chunk “B” has been identified two times. All remaining data chunks229 are written to tape cartridge 4711.

FIG. 3 illustrates a further process 300 with respect to process 200 ofFIG. 2, in accordance with embodiments of the present invention. Process300 illustrates a reserve partition 232 within NVS2. Reserve partition232 includes a database comprising all identified duplicate data chunks“A” and “B” (i.e., identified during the process of FIG. 2). NVS1 204comprises a chunk index database for tape cartridge 4711. A subsequentprocess is executed for writing contents of NVS1 204 and NVS2 208 to aspecified location at a beginning portion of tape cartridge 4711.

FIG. 4 illustrates a process 400 for reading deduplicated data from atape cartridge 4712 via NVS1 204 and NVS2 208, in accordance withembodiments of the present invention. Process 400 illustrates tapecartridge 4712 being mounted to a storage tape drive hardware device(e.g., storage tape drive hardware device 100 of FIG. 1) for executing adata read operation. A chunk database is read from tape cartridge 4712to NVS2 208. An index database is read from tape cartridge 4712 to NVS1204.

FIG. 5 illustrates a further process 500 with respect to process 400 ofFIG. 4, in accordance with embodiments of the present invention. Process500 illustrates reserve partition within NVS 204 preloaded with a chunkindex database 522. The process is initiated when data chunks 512 areread back from tape cartridge 4712 to NVS2 208. Any gaps 535 (of datachunks 512) to be filled are identified and missing data chunks 537 areadded to data chunks 512 based on information from the chunk indexdatabase 522 with respect to information from a reserved database ofNVS2. Deduplication engine 210 transmits the complete data stream 550back to a host device.

FIG. 6 illustrates a process executed within a storage tape drivehardware device 600, in accordance with embodiments of the presentinvention. Storage tape drive hardware device 600 comprises a tape drivememory unit 604 (comprising tape drive microcode 608 and a deduplicationengine 610) connected to NVS2 614 and NVS1 618 for communications with atape cartridge 620. The process is initiated when data is received (viatape drive memory 604) form a data host. Tape drive microcode 608 anddeduplication engine 610 identify duplicate data chunks (within NVS2614) and replace the duplicate data chunks with location pointersassociated with NVS1 618. All remaining data chunks are stored withintape cartridge 620.

FIG. 7 illustrates a storage tape drive hardware library system 700 forimproving a tape drive memory storage process, in accordance withembodiments of the present invention. Storage tape drive hardwarelibrary system 700 integrates multiple storage tape drive hardwaredevices (e.g., as illustrated in FIG. 8, infra) for executing adeduplication process. Storage tape drive hardware library system 700reduces/eliminates a data learning process of single storage tape drivehardware devices by sharing previously learned information with a tapelibrary manager device and the integrated hardware devices therebyincreasing a compression ratio by eliminating a learning curve resultingin a better fit with respect to top deduplication data chunks. Storagetape drive hardware library system 700 integrates an additionaldeduplication memory device 710 a within a tape library manager device710. Deduplication memory device 710 a temporarily stores the mostpopular depuplicated hashes representing data chunks and associated datachunk populations. Data chunks are processed using a hash algorithm.Extra copies of the same data chunks are deleted thereby leaving only asingle copy to be stored. Data is analyzed to identify duplicate bytepatterns to ensure a single instance of a data chunk comprises a singledata file. Duplicate data chunks are replaced with a reference thatpoints to the stored chunks. Hash based data de-duplication methods inaccordance with embodiments of the invention use a hashing algorithm toidentify the chunks of data. When data is processed via a hashingalgorithm, a hash is created that represents the data. A hash comprisesa bit string (e.g., 128 bits) that represents the data being processed.If the same date has been processed through the hashing algorithmmultiple times, the same hash is calculated each time thereby indicatingthat the data are the same.

Each new empty tape (upon mounting to storage tape drive hardwarelibrary system 700) will request the most popular depuplicated hashesfrom tape library manager 710. The most popular depuplicated hashes areused to initiate a deduplication process with respect to an empty tapethereby eliminating a learning curve. Each previously used tape comparesand synchronizes current data with the requested most populardepuplicated hashes from tape library manager 710. Each tape beingunmounted (from storage tape drive hardware library system 700) willsynchronize additionally learned deduplications with tape librarymanager 710 to further update storage tape drive hardware library system700 with the most popular depuplicated hashes.

Storage tape drive hardware library system 700 of FIG. 7 includes anelectro/mechanical structure 720 (for placement of storage tape hardwaredevices) and a tape library manager 710 comprising a managernon-volatile memory device (MNVS) 710 a and a CPU 710 b. Theelectro/mechanical structure 720 comprises mechanical structures (e.g.,motors, springs, drive mechanisms, retainer hardware, column structure,etc.) and electrical circuitry (integrated circuits, switches, etc.) forcontrolling placement of storage tape hardware devices. MNVS 104 maycomprise any type of specialized memory devices including, inter alia,an integrated circuit based memory device, a removable flash memorydevice, etc. MNVS 104 comprises a hash database including a tapecartridge identifier. Storage tape drive hardware library system 700 maycomprise an embedded computer or any type of specialized embeddedhardware device. An embedded computer is defined herein as a dedicatedcomputer comprising a combination of computer hardware and software(fixed in capability or programmable) specifically designed forexecuting a specialized function. Programmable embedded computers maycomprise specialized programming interfaces. Additionally, storage tapedrive hardware library system 700 may comprise a specialized hardwaredevice comprising specialized (non-generic) hardware and circuitry(i.e., specialized discrete non-generic analog, digital, and logic basedcircuitry) for executing a process described with respect to FIGS. 7-18.The specialized discrete non-generic analog, digital, and logic basedcircuitry may include proprietary specially designed components (e.g., aspecialized integrated circuit designed for only implementing anautomated process for improving tape drive memory storage process).Storage tape drive hardware library system 700 includes specializedmemory devices MNVS 710 a. The specialized memory may include a singlememory system. Alternatively, the specialized memory may include aplurality of memory systems. Storage tape drive hardware library system700 may include sensors, processors, and additional software andspecialized circuitry. Sensors may include, inter alfa, storage sensors,optical sensors, speed sensors, etc.

FIG. 8 illustrates a storage tape drive hardware library system 800comprising multiple storage tape drive hardware devices, in accordancewith embodiments of the present invention. Storage tape drive hardwarelibrary system comprises a deduplication storage tape drive hardwaredevice 804 and a deduplication storage tape drive hardware device 808placed adjacent to a standard storage tape drive hardware device 806within storage tape drive hardware library system 800. A picker assembly810 is configured to move in a direction 815 to place tape cartridgeswithin deduplication storage tape drive hardware device 804,deduplication storage tape drive hardware device 808, and/or standardstorage tape drive hardware device 806.

FIG. 9 illustrates a detailed view of a tape library manager 910, inaccordance with embodiments of the present invention. Tape librarymanager 910 comprises a manager non-volatile memory device (MNVS) 910 aand a CPU 910 b. CPU 910 b creates a hash database (within MNVS 910 a ),merges new data into the hash database, and merges any removed storagetape cartridge data including drive tape identification. Tape librarymanager 910 is connected to a storage tape drive hardware device(s) viaan Ethernet connection. During a storage tape cartridge removal process,contents of a hash database (of the associated storage tape drivehardware device) are copied to the storage tape cartridge. If the datachunks are determined to be corrupt, then alternative data chunksassociated with the hash data are requested from the tape librarymanager 910. In response, tape library manager 910 will transmit therequested alternative data chunks.

FIG. 10 illustrates an operational algorithm detailing a process flowenabled by system 100 of FIG. 1 for executing a hash database enabledprocess, in accordance with embodiments of the present invention. Theprocess is initiated when a drive 1 (i.e., storage tape drive hardwaredevice) has completed a job 1020 and performs a rewind/unload process1022 with respect to the storage tape cartridge. Subsequently, a hashdatabase 1010 a generated during a last job is copied 1024 via anEthernet interface to the tape library manager 1010. In response, tapelibrary manager 1010 merges the hash data coming from drive 1 into thecommon hash data base of MNVS 1010 a. Subsequently, a drive 2 (i.e.,storage tape drive hardware device) receives a mount request 1035 andthe storage tape cartridge requested is mounted 1034. A request isinitiated with respect to the tape library manager 1010 for the commonhash database comprising hashes located by the drive 1. In response, thecommon hash data base is copied 1027 to the drive 2 and it is reportedto host as drive mount complete 1029 thereby indicating that the drive 2is ready for a job to start. The drive 2 will now be equipped with allhashes from the common data base and identifies all associated datachunks 1031.

FIG. 11 illustrates a process 1100 for deduplicating and writing datavia NVS1 1104 (comprising a hash database) and NVS2 1108, in accordancewith embodiments of the present invention. Process 1100 illustrates adata stream 1105 received from a data host device. Data stream 1105 isprocessed (within NVS2 1108) by a deduplication software engine 1110(comprising software microcode) resulting in the deletion of data chunks“A” and “B” from NVS2 1108. Additionally, a position pointer associatedwith the remaining data chunks 1118 (being stored within tape cartridge4711) is stored within the hash database within NVS1 1104. A subsequentanalysis is performed to analyze the incoming data stream 1124 until aspecified number (i.e., a threshold) of duplicate data chunks areidentified. For example (with respect to FIG. 11), data chunk “A” hasbeen identified three times and data chunk “B” has been identified twotimes. All remaining data chunks 1129 are written to tape cartridge4711. Additionally, during a tape cartridge mount process, the chunkdatabase is copied from a tape library manager to NVS1.

FIG. 12 illustrates a further process 1200 with respect to process 1100of FIG. 11, in accordance with embodiments of the present invention.Process 1200 illustrates a reserve partition 1232 within NVS2. Reservepartition 1232 includes a database comprising all identified duplicatedata chunks “A” and “B” (i.e., identified during the process of FIG.11). NVS1 1104 comprises a hash database for tape cartridge 4711. Asubsequent process is executed for writing contents of NVS1 1104 andNVS2 1108 to a specified location at a beginning portion of tapecartridge 4711. Additionally, the hash databased is copied to a tapelibrary manager.

FIG. 13 illustrates a process 1300 for reading deduplicated data from atape cartridge 4712 via NVS1 1104 and NVS2 1108, in accordance withembodiments of the present invention. Process 1300 illustrates tapecartridge 4712 being mounted to a storage tape drive hardware device(e.g., storage tape drive hardware device 100 of FIG. 1) for executing adata read operation. A chunk database is read from tape cartridge 4712to NVS2 1108. A hash database is read from a library manger device 1371to NVS1 1104.

FIG. 14 illustrates a further process 1400 with respect to process 1300of FIG. 13, in accordance with embodiments of the present invention.Process 1400 illustrates reserve partition within NVS1 1108 preloadedwith a hash database 1422. The process is initiated when data chunks1412 are read back from tape cartridge 4712 to NVS2 1108. Any gaps 1435(of data chunks 1412) to be filled are identified and missing datachunks 1437 are added to data chunks 1412 based on information from thechunk index database 1422 with respect to information from a reserveddatabase of NVS2 1108. Deduplication engine 1410 transmits the completedata stream 1450 back to a host device.

FIG. 15 illustrates a process identifying missing data chunks, inaccordance with embodiments of the present invention. In step 1502, astorage tape cartridge mount request is read. In step 1504, a librarymanager database is read. In step 1506, a chunk database is recalledfrom a storage tape cartridge. In step 1508, a mount complete indicator(for the mounted storage tape cartridge) is reported to a data hostdevice. In step 1510, missing data chunks are identified using hashesfrom an NVS1 and the missing data chunks are replaced from an NVS2. Instep 1512, a host data complete indicator is requested. In step 1514,the storage tape cartridge is rewound and unloaded from an associateddrive device. In step 1518, the host job is completed.

FIG. 16 illustrates a process identifying corrupt data chunks, inaccordance with embodiments of the present invention. In step 1602, astorage tape cartridge mount request is read. In step 1604, a librarymanager database is read. In step 1606, a chunk database is recalledfrom a storage tape cartridge. In step 1608, a mount complete indicator(for the mounted storage tape cartridge) is reported to a data hostdevice. In step 1610, missing data chunks are identified using hashesfrom an NVS1 and the missing data chunks are replaced from an NVS2. Instep 1612, a host data complete indicator is requested. In step 1617, acorrupt data chunk is detected. In step 1619, an alternative data chunkis requested from a library manager device. In step 1622, thealternative data chunk is received and used to replace the corrupt datachunk. In step 1624, the storage tape cartridge is rewound and unloadedfrom an associated drive device. In step 1626, the host job iscompleted.

FIG. 17 illustrates an algorithm detailing a process flow enabled bysystem 100 of FIG. 1 for improving tape drive memory storage viaexecution of an internal data deduplication process, in accordance withembodiments of the present invention. Each of the steps in the algorithmof FIG. 17 may be enabled and executed in any order by a computerprocessor(s) executing computer code. In step 1700, a data stream isreceived (by a storage tape drive hardware device of a hardware librarysystem including a plurality of storage tape drive hardware devices) forstorage. The storage tape drive hardware device internally comprises adeduplication software engine, a first non-volatile memory device(NVS1), a second non-volatile memory device (NVS2), and a first datastorage tape cartridge. The data stream is stored within NVS2. NVS1 andNVS2 may comprise integrated circuit based memory devices. In step 1702,duplicate data chunks of a plurality of adjacent variable length datachunks of the data stream are identified within NVS2. The duplicate datachunks include duplicated data with respect to a group of data chunks ofthe plurality of adjacent variable length data chunks. The duplicatedata chunks are deleted from NVS2 such that the group of data chunksremains within NVS2. In step 1704, the group of data chunks is writtento a first data storage tape cartridge of the storage tape drivehardware device. In step 1708, pointers are generated. The pointers areassociated with a location within NVS1 for storing de-duplication hashesidentifying each data chunk of the group of data chunks stored withinthe first data storage tape cartridge. The pointers are stored withinthe first data storage tape cartridge. In step 1712, the de-duplicationhashes are written from the NVS1 to a manager non-volatile memory device(MNVS) of the storage tape drive hardware library system. In step 1714,the MNVS is updated by combining the de-duplication hashes with aplurality of additional de-duplication hashes identifying a plurality ofcommonly used de-duplicated data chunks stored within the plurality ofstorage tape drive hardware devices. In step 1718, first data storagetape cartridge is removed from the storage tape drive hardware deviceand a second data storage tape cartridge is placed within a secondstorage tape drive hardware device of the plurality of storage tapedrive hardware devices. In step 1720, the de-duplication hashes combinedwith the plurality of additional de-duplication hashes are written fromthe MNVS to an additional NVS1 of the second storage tape drive hardwaredevice. In step 1722, an additional data stream is received for storage.The additional data stream is divided into a second plurality ofadjacent variable length data chunks. In step 1724, the second pluralityof adjacent variable length data chunks are stored within an additionalNVS2 of the second storage tape drive hardware device. In step 1728, thesecond plurality of adjacent variable length data chunks arede-duplicated (based on the de-duplication hashes combined with theplurality of additional de-duplication hashes) such that a second groupof de-duplicated data chunks remain within the additional NVS2. Thesecond group of de-duplicated data chunks is written to the second datastorage tape cartridge of the second storage tape drive hardware device.In step 1730, additional pointers are generated. The additional pointersare associated with a location within the additional NVS1 for storingthe de-duplication hashes combined with the plurality of additionalde-duplication hashes. The pointers are stored within the second datastorage tape cartridge. In step 1734, all additional de-duplicationhashes associated with all additional de-duplicated data chunks(processed by the plurality of storage tape drive hardware devices andthe storage tape drive hardware library system) are synchronized withall de-duplication hashes within the MNVS such that the MNVS is updatedwith currently updated de-duplication hashes associated with currentlyupdated de-duplicated data chunks. In step 1736, a data corruptioncorrection process is executed. The data corruption correction processincludes: (1) detecting corrupted data chunks stored within a storagetape drive hardware device of the plurality of storage tape drivehardware devices; (2) retrieving (from the MNVS) pointers associatedwith functional data chunks of at least one additional NVS2 of theplurality of storage tape drive hardware devices comprising data storagetape cartridges including the functional data chunks; and (3) replacingthe corrupted data chunks with the functional data chunks.

FIG. 18 illustrates a computer system 90 (e.g., the storage tape drivehardware device of FIG. 1 or the tape library manager system of FIG. 7)used by or comprised by the system of FIGS. 1 and 7 for improving a tapedrive memory storage process, in accordance with embodiments of thepresent invention.

Aspects of the present invention may take the form of an entirelyhardware embodiment, an entirely software embodiment (includingfirmware, resident software, micro-code, etc.) or an embodimentcombining software and hardware aspects that may all generally bereferred to herein as a “circuit,” “module,” or “system.”

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing apparatus receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, device(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing device to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing device, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing device, and/or other devicesto function in a particular manner, such that the computer readablestorage medium having instructions stored therein comprises an articleof manufacture including instructions which implement aspects of thefunction/act specified in the flowchart and/or block diagram block orblocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing device, or other device tocause a series of operational steps to be performed on the computer,other programmable device or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable device, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

The computer system 90 illustrated in FIG. 18 includes a processor 91,an input device 92 coupled to the processor 91, an output device 93coupled to the processor 91, and memory devices 94 and 95 each coupledto the processor 91. The input device 92 may be, inter alia, a keyboard,a mouse, a camera, a touchscreen, etc. The output device 93 may be,inter alia, a printer, a plotter, a computer screen, a magnetic tape, aremovable hard disk, a floppy disk, etc. The memory devices 94 and 95may be, inter alia, a hard disk, a floppy disk, a magnetic tape, anoptical storage such as a compact disc (CD) or a digital media disc(DVD), a dynamic random access memory (DRAM), a read-only memory (ROM),etc. The memory device 95 includes a computer code 97. The computer code97 includes algorithms (e.g., the algorithms of FIGS. 10 and 15-17) forenabling a process for improving a tape drive memory storage process.The processor 91 executes the computer code 97. The memory device 94includes input data 96. The input data 96 includes input required by thecomputer code 97. The output device 93 displays output from the computercode 97. Either or both memory devices 94 and 95 (or one or moreadditional memory devices Such as read only memory device 96) mayinclude algorithms (e.g., the algorithms of FIGS. 10 and 15-17) and maybe used as a computer usable medium (or a computer readable medium or aprogram storage device) having a computer readable program code embodiedtherein and/or having other data stored therein, wherein the computerreadable program code includes the computer code 97. Generally, acomputer program product (or, alternatively, an article of manufacture)of the computer system 90 may include the computer usable medium (or theprogram storage device).

In some embodiments, rather than being stored and accessed from a harddrive, optical disc or other writeable, rewriteable, or removablehardware memory device 95, stored computer program code 84 (e.g.,including algorithms) may be stored on a static, nonremovable, read-onlystorage medium such as a Read-Only Memory (ROM) device 85, or may beaccessed by processor 91 directly from such a static, nonremovable,read-only medium 85. Similarly, in some embodiments, stored computerprogram code 97 may be stored as computer-readable firmware 85, or maybe accessed by processor 91 directly from such firmware 85, rather thanfrom a more dynamic or removable hardware data-storage device 95, suchas a hard drive or optical disc.

Still yet, any of the components of the present invention could becreated, integrated, hosted, maintained, deployed, managed, serviced,etc. by a service supplier who offers to improve a tape drive memorystorage process. Thus, the present invention discloses a process fordeploying, creating, integrating, hosting, maintaining, and/orintegrating computing infrastructure, including integratingcomputer-readable code into the computer system 90, wherein the code incombination with the computer system 90 is capable of performing amethod for improving a tape drive memory storage process. In anotherembodiment, the invention provides a business method that performs theprocess steps of the invention on a subscription, advertising, and/orfee basis. That is, a service supplier, such as a Solution Integrator,could offer to enable a process for improving a tape drive memorystorage process. In this case, the service supplier can create,maintain, support, etc. a computer infrastructure that performs theprocess steps of the invention for one or more customers. In return, theservice supplier can receive payment from the customer(s) under asubscription and/or fee agreement and/or the service supplier canreceive payment from the sale of advertising content to one or morethird parties.

While FIG. 18 shows the computer system 90 as a particular configurationof hardware and software, any configuration of hardware and software, aswould be known to a person of ordinary skill in the art, may be utilizedfor the purposes stated supra in conjunction with the particularcomputer system 90 of FIG. 18. For example, the memory devices 94 and 95may be portions of a single memory device rather than separate memorydevices.

While embodiments of the present invention have been described hereinfor purposes of illustration, many modifications and changes will becomeapparent to those skilled in the art. Accordingly, the appended claimsare intended to encompass all such modifications and changes as fallwithin the true spirit and scope of this invention.

What is claimed is:
 1. A tape drive memory storage improvement methodcomprising: receiving, by a processor of a storage tape drive hardwaredevice of a storage tape drive hardware library system comprising aplurality of storage tape drive hardware devices, a data stream forstorage, wherein said storage tape drive hardware device internallycomprises a deduplication software engine, a non-volatile memory device(NVS1), a non-volatile memory device (NVS2), and a first data storagetape cartridge; identifying, by said processor within said NVS2,duplicate data chunks of a plurality of adjacent variable length datachunks of said data stream, wherein said duplicate data chunks compriseduplicated data with respect to a first group of data chunks of saidplurality of adjacent variable length data chunks; deleting, by saidprocessor from said NVS2, said duplicate data chunks such that saidfirst group of data chunks remain within said NVS2; writing, by saidprocessor to a first data storage tape cartridge of said storage tapedrive hardware device, said first group of data chunks; generating, bysaid processor, pointers associated with a location within said NVS1storing de-duplication hashes identifying each data chunk of said firstgroup of data chunks stored within said first data storage tapecartridge; storing, by said processor, said pointers within said firstdata storage tape cartridge; writing, by said processor from said NVS1to a manager non-volatile memory device (MNVS) of said storage tapedrive hardware library system, said de-duplication hashes; and updating,by said processor, said MNVS by combining said de-duplication hasheswith a plurality of additional de-duplication hashes identifying aplurality of commonly used de-duplicated data chunks stored within saidplurality of storage tape drive hardware devices.
 2. The method of claim1, wherein said first data storage tape cartridge is removed from saidstorage tape drive hardware device, wherein a second data storage tapecartridge is placed within a second storage tape drive hardware deviceof said plurality of storage tape drive hardware devices, and whereinsaid method further comprises: writing, from said MNVS to an additionalNVS1 of said second storage tape drive hardware device, saidde-duplication hashes combined with said plurality of additionalde-duplication hashes; receiving an additional data stream for storage;dividing said additional data stream into a second plurality of adjacentvariable length data chunks; storing, within an additional NVS2 of saidsecond storage tape drive hardware device, said second plurality ofadjacent variable length data chunks; de-duplicating, based on saidde-duplication hashes combined with said plurality of additionalde-duplication hashes, said second plurality of adjacent variable lengthdata chunks such that a second group of de-duplicated data chunks remainwithin said additional NVS2; writing, by said processor to said seconddata storage tape cartridge of said second storage tape drive hardwaredevice, said second group of de-duplicated data chunks; generating, bysaid processor, additional pointers associated with a location withinsaid additional NVS1 storing said de-duplication hashes combined withsaid plurality of additional de-duplication hashes; and storing, by saidprocessor, said pointers within said second data storage tape cartridge.3. The method of claim 2, wherein said storage tape drive hardwarelibrary system further comprises a communication component, and whereinsaid method further comprises: synchronizing with all de-duplicationhashes within said MNVS, via said communication component, alladditional de-duplication hashes associated with all additionalde-duplicated data chunks processed by said plurality of storage tapedrive hardware devices and said storage tape drive hardware librarysystem such that said MNVS is updated with currently updatedde-duplication hashes associated with currently updated de-duplicateddata chunks.
 4. The method of claim 2, further comprising: detectingcorrupted data chunks stored within a storage tape drive hardware deviceof said plurality of storage tape drive hardware devices; retrieving,from said MNVS, pointers associated with functional data chunks of atleast one additional NVS2 of said plurality of storage tape drivehardware devices comprising data storage tape cartridges including saidfunctional data chunks; replacing said corrupted data chunks with saidfunctional data chunks.
 5. The method of claim 1, further comprising:providing an Ethernet connection between said MNVS and said plurality ofstorage tape drive hardware devices.
 6. The method of claim 1, whereinsaid MNVS comprises a memory device selected from the group consistingof an integrated circuit based memory device and a removable flashmemory device.
 7. The method of claim 1, wherein said MNVS comprises ahash database.
 8. The method of claim 1, further comprising: encrypting,by said processor, all hashes within said MNVS.
 9. The method of claim1, further comprising: providing at least one support service for atleast one of creating, integrating, hosting, maintaining, and deployingcomputer-readable code in the storage tape drive hardware device, saidcode being executed by the processor to implement: said receiving, saididentifying, said deleting, said writing said first group of datachunks, said generating said pointers, said storing said pointers, saidwriting said de-duplication hashes, and said updating.
 10. A computerprogram product, comprising a computer readable hardware storage devicestoring a computer readable program code, said computer readable programcode comprising an algorithm that when executed by a processor of astorage tape drive hardware device implements a tape drive memorystorage improvement method, said method comprising: receiving, by saidprocessor, a data stream for storage, wherein said storage tape drivehardware device is comprised by a storage tape drive hardware librarysystem comprising a plurality of storage tape drive hardware devices,and wherein said storage tape drive hardware device internally comprisesa deduplication software engine, a non-volatile memory device (NVS1), anon-volatile memory device (NVS2), and a first data storage tapecartridge; identifying, by said processor within said NVS2, duplicatedata chunks of a plurality of adjacent variable length data chunks ofsaid data stream, wherein said duplicate data chunks comprise duplicateddata with respect to a first group of data chunks of said plurality ofadjacent variable length data chunks; deleting, by said processor fromsaid NVS2, said duplicate data chunks such that said first group of datachunks remain within said NVS2; writing, by said processor to a firstdata storage tape cartridge of said storage tape drive hardware device,said first group of data chunks; generating, by said processor, pointersassociated with a location within said NVS1 storing de-duplicationhashes identifying each data chunk of said first group of data chunksstored within said first data storage tape cartridge; storing, by saidprocessor, said pointers within said first data storage tape cartridge;writing, by said processor from said NVS1 to a manager non-volatilememory device (MNVS) of said storage tape drive hardware library system,said de-duplication hashes; and updating, by said processor, said MNVSby combining said de-duplication hashes with a plurality of additionalde-duplication hashes identifying a plurality of commonly usedde-duplicated data chunks stored within said plurality of storage tapedrive hardware devices.
 11. The computer program product of claim 10,wherein said first data storage tape cartridge is removed from saidstorage tape drive hardware device, wherein a second data storage tapecartridge is placed within a second storage tape drive hardware deviceof said plurality of storage tape drive hardware devices, and whereinsaid method further comprises: writing, from said MNVS to an additionalNVS1 of said second storage tape drive hardware device, saidde-duplication hashes combined with said plurality of additionalde-duplication hashes; receiving an additional data stream for storage;dividing said additional data stream into a second plurality of adjacentvariable length data chunks; storing, within an additional NVS2 of saidsecond storage tape drive hardware device, said second plurality ofadjacent variable length data chunks; de-duplicating, based on saidde-duplication hashes combined with said plurality of additionalde-duplication hashes, said second plurality of adjacent variable lengthdata chunks such that a second group of de-duplicated data chunks remainwithin said additional NVS2; writing, by said processor to said seconddata storage tape cartridge of said second storage tape drive hardwaredevice, said second group of de-duplicated data chunks; generating, bysaid processor, additional pointers associated with a location withinsaid additional NVS1 storing said de-duplication hashes combined withsaid plurality of additional de-duplication hashes; and storing, by saidprocessor, said pointers within said second data storage tape cartridge.12. The computer program product of claim 11, wherein said storage tapedrive hardware library system further comprises a communicationcomponent, and wherein said method further comprises: synchronizing withall de-duplication hashes within said MNVS, via said communicationcomponent, all additional de-duplication hashes associated with alladditional de-duplicated data chunks processed by said plurality ofstorage tape drive hardware devices and said storage tape drive hardwarelibrary system such that said MNVS is updated with currently updatedde-duplication hashes associated with currently updated de-duplicateddata chunks.
 13. The computer program product of claim 11, wherein saidmethod further comprises: detecting corrupted data chunks stored withina storage tape drive hardware device of said plurality of storage tapedrive hardware devices; retrieving, from said MNVS, pointers associatedwith functional data chunks of at least one additional NVS2 of saidplurality of storage tape drive hardware devices comprising data storagetape cartridges including said functional data chunks; replacing saidcorrupted data chunks with said functional data chunks.
 14. The computerprogram product of claim 10, wherein said method further comprises:providing an Ethernet connection between said MNVS and said plurality ofstorage tape drive hardware devices.
 15. The computer program product ofclaim 10, wherein said MNVS comprises a memory device selected from thegroup consisting of an integrated circuit based memory device and aremovable flash memory device.
 16. The computer program product of claim10, wherein said MNVS comprises a hash database.
 17. The computerprogram product of claim 10, further comprising: encrypting, by saidprocessor, all hashes within said MNVS.
 18. A storage tape drivehardware device comprising a processor coupled to a computer-readablememory unit, said memory unit comprising instructions that when executedby the processor implements a tape drive memory storage improvementmethod comprising: receiving, by said processor, a data stream forstorage, wherein said storage tape drive hardware device is comprised bya storage tape drive hardware library system comprising a plurality ofstorage tape drive hardware devices, and wherein said storage tape drivehardware device internally comprises a deduplication software engine, anon-volatile memory device (NVS1), a non-volatile memory device (NVS2),and a first data storage tape cartridge; identifying, by said processorwithin said NVS2, duplicate data chunks of a plurality of adjacentvariable length data chunks of said data stream, wherein said duplicatedata chunks comprise duplicated data with respect to a first group ofdata chunks of said plurality of adjacent variable length data chunks;deleting, by said processor from said NVS2, said duplicate data chunkssuch that said first group of data chunks remain within said NVS2;writing, by said processor to a first data storage tape cartridge ofsaid storage tape drive hardware device, said first group of datachunks; generating, by said processor, pointers associated with alocation within said NVS1 storing de-duplication hashes identifying eachdata chunk of said first group of data chunks stored within said firstdata storage tape cartridge; storing, by said processor, said pointerswithin said first data storage tape cartridge; writing, by saidprocessor from said NVS1 to a manager non-volatile memory device (MNVS)of said storage tape drive hardware library system, said de-duplicationhashes; and updating, by said processor, said MNVS by combining saidde-duplication hashes with a plurality of additional de-duplicationhashes identifying a plurality of commonly used de-duplicated datachunks stored within said plurality of storage tape drive hardwaredevices.
 19. The storage tape drive hardware device of claim 18, whereinsaid first data storage tape cartridge is removed from said storage tapedrive hardware device, wherein a second data storage tape cartridge isplaced within a second storage tape drive hardware device of saidplurality of storage tape drive hardware devices, and wherein saidmethod further comprises: writing, from said MNVS to an additional NVS1of said second storage tape drive hardware device, said de-duplicationhashes combined with said plurality of additional de-duplication hashes;receiving an additional data stream for storage; dividing saidadditional data stream into a second plurality of adjacent variablelength data chunks; storing, within an additional NVS2 of said secondstorage tape drive hardware device, said second plurality of adjacentvariable length data chunks; de-duplicating, based on saidde-duplication hashes combined with said plurality of additionalde-duplication hashes, said second plurality of adjacent variable lengthdata chunks such that a second group of de-duplicated data chunks remainwithin said additional NVS2; writing, by said processor to said seconddata storage tape cartridge of said second storage tape drive hardwaredevice, said second group of de-duplicated data chunks; generating, bysaid processor, additional pointers associated with a location withinsaid additional NVS1 storing said de-duplication hashes combined withsaid plurality of additional de-duplication hashes; and storing, by saidprocessor, said pointers within said second data storage tape cartridge.20. The storage tape drive hardware device of claim 19, wherein saidstorage tape drive hardware library system further comprises acommunication component, and wherein said method further comprises:synchronizing with all de-duplication hashes within said MNVS, via saidcommunication component, all additional de-duplication hashes associatedwith all additional de-duplicated data chunks processed by saidplurality of storage tape drive hardware devices and said storage tapedrive hardware library system such that said MNVS is updated withcurrently updated de-duplication hashes associated with currentlyupdated de-duplicated data chunks.